Real and Fictive Outcomes Are Processed Differently but Converge on a Common Adaptive Mechanism
نویسندگان
چکیده
The ability to learn not only from experienced but also from merely fictive outcomes without direct rewarding or punishing consequences should improve learning and resulting value-guided choice. Using an instrumental learning task in combination with multiple single-trial regression of predictions derived from a computational reinforcement-learning model on human EEG, we found an early temporospatial double dissociation in the processing of fictive and real feedback. Thereafter, real and fictive feedback processing converged at a common final path, reflected in parietal EEG activity that was predictive of future choices. In the choice phase, similar parietal EEG activity related to certainty of the impending response was predictive for the decision on the next trial as well. These parietal EEG effects may reflect a common adaptive cortical mechanism of updating or strengthening of stimulus values by integrating outcomes, learning rate, and certainty, which is active during both decision making and evaluation. Neuronal processing of real (rewarding, punishing) and fictive action outcomes (which would have happened had one acted differently) differs for 400 ms and then converges on a common adaptive mechanism driving future decision making and learning.
منابع مشابه
Saturated Neural Adaptive Robust Output Feedback Control of Robot Manipulators:An Experimental Comparative Study
In this study, an observer-based tracking controller is proposed and evaluatedexperimentally to solve the trajectory tracking problem of robotic manipulators with the torque saturationin the presence of model uncertainties and external disturbances. In comparison with the state-of-the-artobserver-based controllers in the literature, this paper introduces a saturated observer-based controllerbas...
متن کاملGenetic algorithm for Echo cancelling
In this paper, echo cancellation is done using genetic algorithm (GA). The genetic algorithm is implemented by two kinds of crossovers; heuristic and microbial. A new procedure is proposed to estimate the coefficients of adaptive filters used in echo cancellation with combination of the GA with Least-Mean-Square (LMS) method. The results are compared for various values of LMS step size and diff...
متن کاملIndirect Adaptive Interval Type-2 Fuzzy PI Sliding Mode Control for a Class of Uncertain Nonlinear Systems
Controller design remains an elusive and challenging problem foruncertain nonlinear dynamics. Interval type-2 fuzzy logic systems (IT2FLS) incomparison with type-1 fuzzy logic systems claim to effectively handle systemuncertainties especially in the presence of disturbances and noises, but lack aformal mechanism to guarantee performance. In contrast, adaptive sliding modecontrol (ASMC) provides...
متن کاملLearning: Not Just the Facts, Ma'am, but the Counterfactuals as Well
Our brains allow us to consider rewards and other scenarios that could have happened but did not. Such counterfactual outcomes can influence our choices and hasten learning. A series of recent studies has begun to untangle the neural circuitry responsible for monitoring counterfactual outcomes. Here, we summarize several recent complementary discoveries, including a new article in the current i...
متن کاملAn Adaptive Congestion Alleviating Protocol for Healthcare Applications in Wireless Body Sensor Networks: Learning Automata Approach
Wireless Body Sensor Networks (WBSNs) involve a convergence of biosensors, wireless communication and networks technologies. WBSN enables real-time healthcare services to users. Wireless sensors can be used to monitor patients’ physical conditions and transfer real time vital signs to the emergency center or individual doctors. Wireless networks are subject to more packet loss and congestion. T...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید
ثبت ناماگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید
ورودعنوان ژورنال:
- Neuron
دوره 79 شماره
صفحات -
تاریخ انتشار 2013